2026-04-02 10:44:36,466 [ 411810 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-04-02 10:44:36,466 [ 411810 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-04-02 10:44:36,466 [ 411810 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-04-02 10:44:36,467 [ 411810 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_laoqnu --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=1e0b53d756cf -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=1 --color=no --durations=0 test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types -vvv" altinityinfra/integration-tests-runner:37a9815fd2fa '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False collecting ... collected 18 items test_reloading_storage_configuration/test.py::test_remove_policy PASSED [ 5%] test_reloading_storage_configuration/test.py::test_remove_volume_from_policy PASSED [ 11%] test_reloading_storage_configuration/test.py::test_update_disk PASSED [ 16%] test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] PASSED [ 22%] test_replication_without_zookeeper/test.py::test_startup_without_zookeeper FAILED [ 27%] test_rocksdb_options/test.py::test_invalid_column_family_options PASSED [ 33%] test_rocksdb_options/test.py::test_invalid_options PASSED [ 38%] test_rocksdb_options/test.py::test_table_invalid_block_based_table_options PASSED [ 44%] test_rocksdb_options/test.py::test_table_invalid_column_family_options PASSED [ 50%] test_rocksdb_options/test.py::test_table_invalid_options PASSED [ 55%] test_rocksdb_options/test.py::test_table_valid_column_family_options PASSED [ 61%] test_rocksdb_options/test.py::test_table_valid_options PASSED [ 66%] test_rocksdb_options/test.py::test_valid_column_family_options PASSED [ 72%] test_rocksdb_options/test.py::test_valid_options PASSED [ 77%] test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage SKIPPED [ 83%] test_storage_hudi/test.py::test_multiple_hudi_files PASSED [ 88%] test_storage_hudi/test.py::test_single_hudi_file PASSED [ 94%] test_storage_hudi/test.py::test_types PASSED [100%] =================================== FAILURES =================================== ________________________ test_startup_without_zookeeper ________________________ start_cluster = def test_startup_without_zookeeper(start_cluster): node1.query( "INSERT INTO test_table VALUES ('2018-10-01', 1), ('2018-10-02', 2), ('2018-10-03', 3)" ) assert node1.query("SELECT COUNT(*) from test_table") == "3\n" assert ( node1.query("SELECT is_readonly from system.replicas where table='test_table'") == "0\n" ) > cluster.run_kazoo_commands_with_retries(drop_zk) test_replication_without_zookeeper/test.py:51: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3317: in run_kazoo_commands_with_retries kazoo_callback(zk) test_replication_without_zookeeper/test.py:38: in drop_zk zk.delete(path="/clickhouse", recursive=True) /usr/local/lib/python3.10/dist-packages/kazoo/client.py:1431: in delete return self._delete_recursive(path) /usr/local/lib/python3.10/dist-packages/kazoo/client.py:1466: in _delete_recursive self.delete(path) /usr/local/lib/python3.10/dist-packages/kazoo/client.py:1433: in delete return self.delete_async(path, version).get() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = block = True, timeout = None def get(self, block=True, timeout=None): """Return the stored value or raise the exception. If there is no value raises TimeoutError. """ with self._condition: if self._exception is not _NONE: if self._exception is None: return self.value raise self._exception elif block: self._condition.wait(timeout) if self._exception is not _NONE: if self._exception is None: return self.value > raise self._exception E kazoo.exceptions.NotEmptyError /usr/local/lib/python3.10/dist-packages/kazoo/handlers/utils.py:86: NotEmptyError ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2026-04-02 10:49:23 [ 313 ] INFO : Running tests in /ClickHouse/tests/integration/test_replication_without_zookeeper/test.py (cluster.py:2788, start) 2026-04-02 10:49:23 [ 313 ] DEBUG : Cluster start called. is_up=False (cluster.py:2795, start) 2026-04-02 10:49:23 [ 313 ] DEBUG : Docker networks for project roottestreplicationwithoutzookeeper are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-04-02 10:49:23 [ 313 ] DEBUG : Docker containers for project roottestreplicationwithoutzookeeper are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-04-02 10:49:23 [ 313 ] DEBUG : Docker volumes for project roottestreplicationwithoutzookeeper are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-04-02 10:49:23 [ 313 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-04-02 10:49:23 [ 313 ] DEBUG : Docker networks for project roottestreplicationwithoutzookeeper are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-04-02 10:49:23 [ 313 ] DEBUG : Docker containers for project roottestreplicationwithoutzookeeper are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-04-02 10:49:23 [ 313 ] DEBUG : Docker volumes for project roottestreplicationwithoutzookeeper are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-04-02 10:49:23 [ 313 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicationwithoutzookeeper_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-04-02 10:49:24 [ 313 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-04-02 10:49:24 [ 313 ] DEBUG : No running containers for project: roottestreplicationwithoutzookeeper (cluster.py:904, cleanup) 2026-04-02 10:49:24 [ 313 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-04-02 10:49:24 [ 313 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2026-04-02 10:49:24 [ 313 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-04-02 10:49:24 [ 313 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-04-02 10:49:24 [ 313 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2026-04-02 10:49:24 [ 313 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2026-04-02 10:49:24 [ 313 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-04-02 10:49:24 [ 313 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-04-02 10:49:24 [ 313 ] DEBUG : Setup directory for instance: node1 (cluster.py:2808, start) 2026-04-02 10:49:24 [ 313 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4534, create_dir) 2026-04-02 10:49:24 [ 313 ] DEBUG : Create directory for common tests configuration (cluster.py:4539, create_dir) 2026-04-02 10:49:24 [ 313 ] DEBUG : Copy common configuration from helpers (cluster.py:4559, create_dir) 2026-04-02 10:49:24 [ 313 ] DEBUG : Generate and write macros file (cluster.py:4602, create_dir) 2026-04-02 10:49:24 [ 313 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replication_without_zookeeper/configs/remote_servers.xml'] to /ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/configs/config.d (cluster.py:4632, create_dir) 2026-04-02 10:49:24 [ 313 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/database (cluster.py:4649, create_dir) 2026-04-02 10:49:24 [ 313 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/logs (cluster.py:4660, create_dir) 2026-04-02 10:49:24 [ 313 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4746, create_dir) 2026-04-02 10:49:24 [ 313 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:1e0b53d756cf', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env (cluster.py:86, _create_env_file) 2026-04-02 10:49:24 [ 313 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-04-02 10:49:24 [ 313 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-04-02 10:49:24 [ 313 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-04-02 10:49:24 [ 313 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-04-02 10:49:24 [ 313 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 824 (connectionpool.py:547, _make_request) 2026-04-02 10:49:24 [ 313 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env', '--project-name', 'roottestreplicationwithoutzookeeper', '--file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', 'pull'] (cluster.py:113, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-04-02 10:49:36 [ 313 ] DEBUG : Setup ZooKeeper (cluster.py:2849, start) 2026-04-02 10:49:36 [ 313 ] DEBUG : Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/log', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/config', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/log', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/config', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/coordination', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/log', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/config', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/coordination'] (cluster.py:2850, start) 2026-04-02 10:49:36 [ 313 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env', '--project-name', 'roottestreplicationwithoutzookeeper', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--verbose', 'up', '-d'] (cluster.py:113, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.config.config.find: Using configuration files: /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.docker_client.get_client: docker-compose version 1.29.2, build unknown (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:docker-py version: (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:CPython version: 3.10.12 (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:OpenSSL version: OpenSSL 3.0.2 15 Mar 2022 (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker base_url: http+docker://localhost (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker version: Platform={'Name': 'Docker Engine - Community'}, Components=[{'Name': 'Engine', 'Version': '23.0.6', 'Details': {'ApiVersion': '1.42', 'Arch': 'amd64', 'BuildTime': '2023-05-05T21:18:13.000000000+00:00', 'Experimental': 'false', 'GitCommit': '9dbdbd4', 'GoVersion': 'go1.19.9', 'KernelVersion': '5.15.0-130-generic', 'MinAPIVersion': '1.12', 'Os': 'linux'}}, {'Name': 'containerd', 'Version': '1.7.25', 'Details': {'GitCommit': 'bcc810d6b9066471b0b6fa75f557a15a1cbf31bb'}}, {'Name': 'runc', 'Version': '1.2.4', 'Details': {'GitCommit': 'v1.2.4-0-g6c52b3f'}}, {'Name': 'docker-init', 'Version': '0.19.0', 'Details': {'GitCommit': 'de40ad0'}}], Version=23.0.6, ApiVersion=1.42, MinAPIVersion=1.12, GitCommit=9dbdbd4, GoVersion=go1.19.9, Os=linux, Arch=amd64, KernelVersion=5.15.0-130-generic, BuildTime=2023-05-05T21:18:13.000000000+00:00 (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestreplicationwithoutzookeeper_default') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info <- () (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info -> {'Architecture': 'x86_64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'BridgeNfIp6tables': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'BridgeNfIptables': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'CPUSet': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'CPUShares': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'CgroupDriver': 'cgroupfs', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'CgroupVersion': '2', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'ContainerdCommit': {'Expected': 'bcc810d6b9066471b0b6fa75f557a15a1cbf31bb', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'ID': 'bcc810d6b9066471b0b6fa75f557a15a1cbf31bb'}, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Containers': 0, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestreplicationwithoutzookeeper_default') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.network.ensure: Creating network "roottestreplicationwithoutzookeeper_default" with the default driver (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network <- (name='roottestreplicationwithoutzookeeper_default', driver=None, options=None, ipam=None, internal=False, enable_ipv6=False, labels={'com.docker.compose.project': 'roottestreplicationwithoutzookeeper', 'com.docker.compose.network': 'default', 'com.docker.compose.version': '1.29.2'}, attachable=True, check_duplicate=True) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network -> {'Id': 'eb48d35ed30a8fb080d367d988e761323a9aeb06d74b7beb34df3c58c5ea50c5', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Warning': ''} (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {, , } (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestreplicationwithoutzookeeper', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:Creating roottestreplicationwithoutzookeeper_zoo2_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo2', number=1)} (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo2', number=1) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:Creating roottestreplicationwithoutzookeeper_zoo3_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo3', number=1)} (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo3', number=1) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:Creating roottestreplicationwithoutzookeeper_zoo1_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo1', number=1)} (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo1', number=1) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 4d4613bbd93d91b5aa5bac440d3e9318162d9760ca8c598d879d3b18cf9175ca (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestreplicationwithoutzookeeper_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/log', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Target': '/var/log/clickhouse-keeper', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config2.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:1e0b53d756cf', user='0', volumes={}, name='roottestreplicationwithoutzookeeper_zoo2_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestreplicationwithoutzookeeper', 'com.docker.compose.service': 'zoo2', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '4d4613bbd93d91b5aa5bac440d3e9318162d9760ca8c598d879d3b18cf9175ca'}, host_config={'NetworkMode': 'roottestreplicationwithoutzookeeper_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestreplicationwithoutzookeeper_default': {'Aliases': ['zoo2'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 115669263a88d912b686b9e287fc16bee1cbca2117872247acd457f35363b92f (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestreplicationwithoutzookeeper_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/log', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Source': '/clickhouse', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Target': '/usr/bin/clickhouse', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config1.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:1e0b53d756cf', user='0', volumes={}, name='roottestreplicationwithoutzookeeper_zoo1_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestreplicationwithoutzookeeper', 'com.docker.compose.service': 'zoo1', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '115669263a88d912b686b9e287fc16bee1cbca2117872247acd457f35363b92f'}, host_config={'NetworkMode': 'roottestreplicationwithoutzookeeper_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/log', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestreplicationwithoutzookeeper_default': {'Aliases': ['zoo1'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 145645690da6e336dd361d9b6821edd92f13c8fd808eec23acff69a2558ba034 (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestreplicationwithoutzookeeper_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/config', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Target': '/var/lib/clickhouse', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config3.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:1e0b53d756cf', user='0', volumes={}, name='roottestreplicationwithoutzookeeper_zoo3_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestreplicationwithoutzookeeper', 'com.docker.compose.service': 'zoo3', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '145645690da6e336dd361d9b6821edd92f13c8fd808eec23acff69a2558ba034'}, host_config={'NetworkMode': 'roottestreplicationwithoutzookeeper_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/keeper3/config', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestreplicationwithoutzookeeper_default': {'Aliases': ['zoo3'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': 'cfc9c04fac533ef89e761b29b7601c2fbe66552d1456395829b48f26d12147db', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('cfc9c04fac533ef89e761b29b7601c2fbe66552d1456395829b48f26d12147db') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '7586ef6f3cab47c9dc1a201724f3b6f95c6e12b6dc33545d51a69f0fb652325f', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('7586ef6f3cab47c9dc1a201724f3b6f95c6e12b6dc33545d51a69f0fb652325f') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '4851cce7fa19c18fd952001ed0cd19abdf1d699d8ba856e57416cbc67141ecd8', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('4851cce7fa19c18fd952001ed0cd19abdf1d699d8ba856e57416cbc67141ecd8') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config2.xml', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('7586ef6f3cab47c9dc1a201724f3b6f95c6e12b6dc33545d51a69f0fb652325f', 'roottestreplicationwithoutzookeeper_default') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config1.xml', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('cfc9c04fac533ef89e761b29b7601c2fbe66552d1456395829b48f26d12147db', 'roottestreplicationwithoutzookeeper_default') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('7586ef6f3cab47c9dc1a201724f3b6f95c6e12b6dc33545d51a69f0fb652325f', 'roottestreplicationwithoutzookeeper_default', aliases=['zoo2', '7586ef6f3cab'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config3.xml', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('4851cce7fa19c18fd952001ed0cd19abdf1d699d8ba856e57416cbc67141ecd8', 'roottestreplicationwithoutzookeeper_default') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('cfc9c04fac533ef89e761b29b7601c2fbe66552d1456395829b48f26d12147db', 'roottestreplicationwithoutzookeeper_default', aliases=['zoo1', 'cfc9c04fac53'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('7586ef6f3cab47c9dc1a201724f3b6f95c6e12b6dc33545d51a69f0fb652325f') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('4851cce7fa19c18fd952001ed0cd19abdf1d699d8ba856e57416cbc67141ecd8', 'roottestreplicationwithoutzookeeper_default', aliases=['zoo3', '4851cce7fa19'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('cfc9c04fac533ef89e761b29b7601c2fbe66552d1456395829b48f26d12147db') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('4851cce7fa19c18fd952001ed0cd19abdf1d699d8ba856e57416cbc67141ecd8') (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo2', number=1) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:Creating roottestreplicationwithoutzookeeper_zoo2_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo3', number=1) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:Creating roottestreplicationwithoutzookeeper_zoo3_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestreplicationwithoutzookeeper', service='zoo1', number=1) (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:Creating roottestreplicationwithoutzookeeper_zoo1_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-04-02 10:49:40 [ 313 ] DEBUG : Wait ZooKeeper to start (cluster.py:2504, wait_zookeeper_to_start) 2026-04-02 10:49:40 [ 313 ] DEBUG : get_instance_ip instance_name=zoo1 (cluster.py:2135, get_instance_ip) 2026-04-02 10:49:40 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestreplicationwithoutzookeeper_zoo1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:40 [ 313 ] DEBUG : get_kazoo_client: zoo1, ip:172.16.3.3, port:2181, use_ssl:False (cluster.py:3286, get_kazoo_client) 2026-04-02 10:49:40 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:40 [ 313 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-02 10:49:40 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:40 [ 313 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-02 10:49:41 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:41 [ 313 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-02 10:49:41 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:41 [ 313 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-02 10:49:43 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:43 [ 313 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-02 10:49:47 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-02 10:49:47 [ 313 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-02 10:49:47 [ 313 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-04-02 10:49:47 [ 313 ] DEBUG : get_instance_ip instance_name=zoo2 (cluster.py:2135, get_instance_ip) 2026-04-02 10:49:47 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestreplicationwithoutzookeeper_zoo2_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:47 [ 313 ] DEBUG : get_kazoo_client: zoo2, ip:172.16.3.2, port:2181, use_ssl:False (cluster.py:3286, get_kazoo_client) 2026-04-02 10:49:47 [ 313 ] INFO : Connecting to 172.16.3.2(172.16.3.2):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-02 10:49:47 [ 313 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-02 10:49:47 [ 313 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-04-02 10:49:47 [ 313 ] DEBUG : get_instance_ip instance_name=zoo3 (cluster.py:2135, get_instance_ip) 2026-04-02 10:49:47 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestreplicationwithoutzookeeper_zoo3_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:47 [ 313 ] DEBUG : get_kazoo_client: zoo3, ip:172.16.3.4, port:2181, use_ssl:False (cluster.py:3286, get_kazoo_client) 2026-04-02 10:49:47 [ 313 ] INFO : Connecting to 172.16.3.4(172.16.3.4):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-04-02 10:49:47 [ 313 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-04-02 10:49:47 [ 313 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-02 10:49:47 [ 313 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-02 10:49:47 [ 313 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-02 10:49:47 [ 313 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-04-02 10:49:47 [ 313 ] DEBUG : All instances of ZooKeeper Secure started (cluster.py:2519, wait_zookeeper_nodes_to_start) 2026-04-02 10:49:47 [ 313 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker-compose --env-file /ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env --project-name roottestreplicationwithoutzookeeper --file /ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') (cluster.py:3146, start) 2026-04-02 10:49:47 [ 313 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env', '--project-name', 'roottestreplicationwithoutzookeeper', '--file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', 'up', '-d', '--no-recreate'] (cluster.py:113, run_and_check) 2026-04-02 10:49:50 [ 313 ] DEBUG : Stderr:Creating roottestreplicationwithoutzookeeper_node1_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:49:50 [ 313 ] DEBUG : Stderr:Creating roottestreplicationwithoutzookeeper_node1_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:49:50 [ 313 ] DEBUG : ClickHouse instance created (cluster.py:3154, start) 2026-04-02 10:49:50 [ 313 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2135, get_instance_ip) 2026-04-02 10:49:50 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestreplicationwithoutzookeeper_node1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:50 [ 313 ] DEBUG : Waiting for ClickHouse start in node1, ip: 172.16.3.5... (cluster.py:3161, start) 2026-04-02 10:49:50 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestreplicationwithoutzookeeper_node1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:50 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:50 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:50 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:50 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:50 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:51 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:52 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:53 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/429ef32adefe7dad2be6bd620f0229b2a0221fce6a05ca75f7f21506b49b7977/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:54 [ 313 ] DEBUG : ClickHouse node1 started (cluster.py:3165, start) 2026-04-02 10:49:54 [ 313 ] DEBUG : Executing query CREATE DATABASE test; CREATE TABLE test_table(date Date, id UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test/replicated', 'node1') ORDER BY id PARTITION BY toYYYYMM(date); on node1 (cluster.py:3602, query) ------------------------------ Captured log call ------------------------------- 2026-04-02 10:49:55 [ 313 ] DEBUG : Executing query INSERT INTO test_table VALUES ('2018-10-01', 1), ('2018-10-02', 2), ('2018-10-03', 3) on node1 (cluster.py:3602, query) 2026-04-02 10:49:56 [ 313 ] DEBUG : Executing query SELECT COUNT(*) from test_table on node1 (cluster.py:3602, query) 2026-04-02 10:49:57 [ 313 ] DEBUG : Executing query SELECT is_readonly from system.replicas where table='test_table' on node1 (cluster.py:3602, query) 2026-04-02 10:49:57 [ 313 ] DEBUG : get_instance_ip instance_name=zoo1 (cluster.py:2135, get_instance_ip) 2026-04-02 10:49:57 [ 313 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestreplicationwithoutzookeeper_zoo1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-02 10:49:57 [ 313 ] DEBUG : get_kazoo_client: zoo1, ip:172.16.3.3, port:2181, use_ssl:False (cluster.py:3286, get_kazoo_client) 2026-04-02 10:49:57 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-02 10:49:57 [ 313 ] DEBUG : run_kazoo_commands_with_retries: zoo1, (cluster.py:3307, run_kazoo_commands_with_retries) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=1): GetChildren(path='/clickhouse', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=1): ['task_queue', 'sessions', 'tables'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=2): GetChildren(path='/clickhouse/task_queue', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=2): ['ddl'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=3): GetChildren(path='/clickhouse/task_queue/ddl', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=3): [] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=4): Delete(path='/clickhouse/task_queue/ddl', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=4): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=5): Delete(path='/clickhouse/task_queue', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=5): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=6): GetChildren(path='/clickhouse/sessions', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=6): ['zookeeper'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=7): GetChildren(path='/clickhouse/sessions/zookeeper', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=7): ['73bbe55f-0ead-4e62-b6dc-e84fce86d8d8'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=8): GetChildren(path='/clickhouse/sessions/zookeeper/73bbe55f-0ead-4e62-b6dc-e84fce86d8d8', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=8): [] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=9): Delete(path='/clickhouse/sessions/zookeeper/73bbe55f-0ead-4e62-b6dc-e84fce86d8d8', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=9): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=10): Delete(path='/clickhouse/sessions/zookeeper', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=10): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=11): Delete(path='/clickhouse/sessions', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=11): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=12): GetChildren(path='/clickhouse/tables', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=12): ['test'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=13): GetChildren(path='/clickhouse/tables/test', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=13): ['replicated'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=14): GetChildren(path='/clickhouse/tables/test/replicated', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=14): ['metadata', 'replicas', 'table_shared_id', 'temp', 'mutations', 'block_numbers', 'pinned_part_uuids', 'lost_part_count', 'quorum', 'log', 'async_blocks', 'part_moves_shard', 'blocks', 'nonincrement_block_numbers', 'leader_election', 'alter_partition_version', 'columns'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=15): GetChildren(path='/clickhouse/tables/test/replicated/metadata', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=15): [] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=16): Delete(path='/clickhouse/tables/test/replicated/metadata', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=16): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=17): GetChildren(path='/clickhouse/tables/test/replicated/replicas', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=17): ['node1'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=18): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=18): ['flags', 'is_lost', 'host', 'log_pointer', 'metadata_version', 'parts', 'metadata', 'mutation_pointer', 'creator_info', 'min_unprocessed_insert_time', 'max_processed_insert_time', 'is_active', 'columns', 'queue'] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=19): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/flags', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=19): [] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=20): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/flags', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=20): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=21): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/is_lost', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=21): [] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=22): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/is_lost', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=22): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=23): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/host', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=23): [] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=24): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/host', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=24): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=25): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/log_pointer', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=25): [] (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=26): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/log_pointer', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=26): True (connection.py:410, _read_response) 2026-04-02 10:49:57 [ 313 ] DEBUG : Sending request(xid=27): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/metadata_version', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:57 [ 313 ] DEBUG : Received response(xid=27): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=28): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/metadata_version', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=28): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=29): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/parts', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=29): ['201810_0_0_0'] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=30): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/parts/201810_0_0_0', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=30): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=31): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/parts/201810_0_0_0', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=31): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=32): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/parts', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=32): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=33): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/metadata', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=33): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=34): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/metadata', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=34): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=35): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/mutation_pointer', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=35): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=36): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/mutation_pointer', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=36): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=37): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/creator_info', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=37): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=38): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/creator_info', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=38): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=39): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/min_unprocessed_insert_time', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=39): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=40): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/min_unprocessed_insert_time', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=40): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=41): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/max_processed_insert_time', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=41): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=42): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/max_processed_insert_time', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=42): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=43): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/is_active', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=43): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=44): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/is_active', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=44): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=45): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/columns', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=45): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=46): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/columns', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=46): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=47): GetChildren(path='/clickhouse/tables/test/replicated/replicas/node1/queue', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=47): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=48): Delete(path='/clickhouse/tables/test/replicated/replicas/node1/queue', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=48): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=49): Delete(path='/clickhouse/tables/test/replicated/replicas/node1', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=49): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=50): Delete(path='/clickhouse/tables/test/replicated/replicas', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=50): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=51): GetChildren(path='/clickhouse/tables/test/replicated/table_shared_id', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=51): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=52): Delete(path='/clickhouse/tables/test/replicated/table_shared_id', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=52): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=53): GetChildren(path='/clickhouse/tables/test/replicated/temp', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=53): ['abandonable_lock-other', 'abandonable_lock-insert'] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=54): GetChildren(path='/clickhouse/tables/test/replicated/temp/abandonable_lock-other', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=54): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=55): Delete(path='/clickhouse/tables/test/replicated/temp/abandonable_lock-other', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=55): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=56): GetChildren(path='/clickhouse/tables/test/replicated/temp/abandonable_lock-insert', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=56): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=57): Delete(path='/clickhouse/tables/test/replicated/temp/abandonable_lock-insert', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=57): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=58): Delete(path='/clickhouse/tables/test/replicated/temp', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=58): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=59): GetChildren(path='/clickhouse/tables/test/replicated/mutations', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=59): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=60): Delete(path='/clickhouse/tables/test/replicated/mutations', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=60): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=61): GetChildren(path='/clickhouse/tables/test/replicated/block_numbers', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=61): ['201810'] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=62): GetChildren(path='/clickhouse/tables/test/replicated/block_numbers/201810', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=62): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=63): Delete(path='/clickhouse/tables/test/replicated/block_numbers/201810', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=63): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=64): Delete(path='/clickhouse/tables/test/replicated/block_numbers', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=64): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=65): GetChildren(path='/clickhouse/tables/test/replicated/pinned_part_uuids', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=65): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=66): Delete(path='/clickhouse/tables/test/replicated/pinned_part_uuids', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=66): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=67): GetChildren(path='/clickhouse/tables/test/replicated/lost_part_count', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=67): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=68): Delete(path='/clickhouse/tables/test/replicated/lost_part_count', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=68): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=69): GetChildren(path='/clickhouse/tables/test/replicated/quorum', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=69): ['parallel', 'last_part', 'failed_parts'] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=70): GetChildren(path='/clickhouse/tables/test/replicated/quorum/parallel', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=70): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=71): Delete(path='/clickhouse/tables/test/replicated/quorum/parallel', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=71): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=72): GetChildren(path='/clickhouse/tables/test/replicated/quorum/last_part', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=72): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=73): Delete(path='/clickhouse/tables/test/replicated/quorum/last_part', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=73): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=74): GetChildren(path='/clickhouse/tables/test/replicated/quorum/failed_parts', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=74): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=75): Delete(path='/clickhouse/tables/test/replicated/quorum/failed_parts', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=75): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=76): Delete(path='/clickhouse/tables/test/replicated/quorum', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=76): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=77): GetChildren(path='/clickhouse/tables/test/replicated/log', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=77): ['log-0000000000'] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=78): GetChildren(path='/clickhouse/tables/test/replicated/log/log-0000000000', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=78): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=79): Delete(path='/clickhouse/tables/test/replicated/log/log-0000000000', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=79): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=80): Delete(path='/clickhouse/tables/test/replicated/log', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=80): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=81): GetChildren(path='/clickhouse/tables/test/replicated/async_blocks', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=81): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=82): Delete(path='/clickhouse/tables/test/replicated/async_blocks', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=82): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=83): GetChildren(path='/clickhouse/tables/test/replicated/part_moves_shard', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=83): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=84): Delete(path='/clickhouse/tables/test/replicated/part_moves_shard', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=84): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=85): GetChildren(path='/clickhouse/tables/test/replicated/blocks', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=85): ['201810_2956868034535131113_3759223844523231509'] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=86): GetChildren(path='/clickhouse/tables/test/replicated/blocks/201810_2956868034535131113_3759223844523231509', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=86): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=87): Delete(path='/clickhouse/tables/test/replicated/blocks/201810_2956868034535131113_3759223844523231509', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=87): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=88): Delete(path='/clickhouse/tables/test/replicated/blocks', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=88): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=89): GetChildren(path='/clickhouse/tables/test/replicated/nonincrement_block_numbers', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=89): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=90): Delete(path='/clickhouse/tables/test/replicated/nonincrement_block_numbers', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=90): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=91): GetChildren(path='/clickhouse/tables/test/replicated/leader_election', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=91): ['leader_election-0'] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=92): GetChildren(path='/clickhouse/tables/test/replicated/leader_election/leader_election-0', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=92): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=93): Delete(path='/clickhouse/tables/test/replicated/leader_election/leader_election-0', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=93): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=94): Delete(path='/clickhouse/tables/test/replicated/leader_election', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=94): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=95): GetChildren(path='/clickhouse/tables/test/replicated/alter_partition_version', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=95): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=96): Delete(path='/clickhouse/tables/test/replicated/alter_partition_version', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=96): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=97): GetChildren(path='/clickhouse/tables/test/replicated/columns', watcher=None) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=97): [] (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=98): Delete(path='/clickhouse/tables/test/replicated/columns', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=98): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=99): Delete(path='/clickhouse/tables/test/replicated', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=99): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=100): Delete(path='/clickhouse/tables/test', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=100): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=101): Delete(path='/clickhouse/tables', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received response(xid=101): True (connection.py:410, _read_response) 2026-04-02 10:49:58 [ 313 ] DEBUG : Sending request(xid=102): Delete(path='/clickhouse', version=-1) (connection.py:312, _submit) 2026-04-02 10:49:58 [ 313 ] DEBUG : Received error(xid=102) NotEmptyError() (connection.py:392, _read_response) ---------------------------- Captured log teardown ----------------------------- 2026-04-02 10:50:01 [ 313 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env', '--project-name', 'roottestreplicationwithoutzookeeper', '--file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', 'stop', '--timeout', '20'] (cluster.py:113, run_and_check) 2026-04-02 10:50:08 [ 313 ] WARNING : Connection dropped: outstanding heartbeat ping not received (connection.py:622, _connect_attempt) 2026-04-02 10:50:08 [ 313 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-02 10:50:08 [ 313 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-02 10:50:08 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:50:08 [ 313 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-02 10:50:08 [ 313 ] INFO : Connecting to 172.16.3.3(172.16.3.3):2181, use_ssl: False (connection.py:650, _connect) 2026-04-02 10:50:09 [ 313 ] DEBUG : Stderr:Stopping roottestreplicationwithoutzookeeper_node1_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Stderr:Stopping roottestreplicationwithoutzookeeper_zoo3_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Stderr:Stopping roottestreplicationwithoutzookeeper_zoo1_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Stderr:Stopping roottestreplicationwithoutzookeeper_zoo2_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Stderr:Stopping roottestreplicationwithoutzookeeper_node1_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Stderr:Stopping roottestreplicationwithoutzookeeper_zoo2_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Stderr:Stopping roottestreplicationwithoutzookeeper_zoo3_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Stderr:Stopping roottestreplicationwithoutzookeeper_zoo1_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true'] (cluster.py:113, run_and_check) 2026-04-02 10:50:09 [ 313 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/.env', '--project-name', 'roottestreplicationwithoutzookeeper', '--file', '/ClickHouse/tests/integration/test_replication_without_zookeeper/_instances_1/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', 'down', '--volumes'] (cluster.py:113, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing roottestreplicationwithoutzookeeper_node1_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing roottestreplicationwithoutzookeeper_zoo3_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing roottestreplicationwithoutzookeeper_zoo1_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing roottestreplicationwithoutzookeeper_zoo2_1 ... (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing roottestreplicationwithoutzookeeper_zoo1_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing roottestreplicationwithoutzookeeper_zoo3_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing roottestreplicationwithoutzookeeper_node1_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing roottestreplicationwithoutzookeeper_zoo2_1 ... done (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stderr:Removing network roottestreplicationwithoutzookeeper_default (cluster.py:123, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-04-02 10:50:11 [ 313 ] DEBUG : Docker networks for project roottestreplicationwithoutzookeeper are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-04-02 10:50:11 [ 313 ] DEBUG : Docker containers for project roottestreplicationwithoutzookeeper are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-04-02 10:50:11 [ 313 ] DEBUG : Docker volumes for project roottestreplicationwithoutzookeeper are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-04-02 10:50:11 [ 313 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicationwithoutzookeeper_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-04-02 10:50:11 [ 313 ] DEBUG : No running containers for project: roottestreplicationwithoutzookeeper (cluster.py:904, cleanup) 2026-04-02 10:50:11 [ 313 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-04-02 10:50:11 [ 313 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2026-04-02 10:50:11 [ 313 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2026-04-02 10:50:11 [ 313 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2026-04-02 10:50:11 [ 313 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-04-02 10:50:11 [ 313 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ============================== slowest durations =============================== 338.10s call test_storage_hudi/test.py::test_multiple_hudi_files 114.76s call test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 50.58s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 39.84s call test_rocksdb_options/test.py::test_table_invalid_options 38.54s setup test_storage_hudi/test.py::test_multiple_hudi_files 34.41s call test_rocksdb_options/test.py::test_table_invalid_column_family_options 33.10s call test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 32.31s setup test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 31.24s setup test_reloading_storage_configuration/test.py::test_remove_policy 29.95s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 29.79s call test_rocksdb_options/test.py::test_invalid_column_family_options 28.62s call test_rocksdb_options/test.py::test_invalid_options 26.65s setup test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage 25.96s teardown test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage 25.72s teardown test_storage_hudi/test.py::test_types 20.70s setup test_rocksdb_options/test.py::test_invalid_column_family_options 15.64s call test_reloading_storage_configuration/test.py::test_update_disk 13.50s call test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 13.00s call test_reloading_storage_configuration/test.py::test_remove_policy 12.28s teardown test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 9.39s call test_storage_hudi/test.py::test_types 9.20s teardown test_reloading_storage_configuration/test.py::test_update_disk 8.40s call test_storage_hudi/test.py::test_single_hudi_file 6.18s teardown test_rocksdb_options/test.py::test_valid_options 3.33s call test_rocksdb_options/test.py::test_valid_options 3.24s call test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 0.68s call test_rocksdb_options/test.py::test_table_valid_column_family_options 0.67s call test_rocksdb_options/test.py::test_valid_column_family_options 0.62s call test_rocksdb_options/test.py::test_table_valid_options 0.58s call test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage 0.01s teardown test_storage_hudi/test.py::test_multiple_hudi_files 0.00s teardown test_storage_hudi/test.py::test_single_hudi_file 0.00s setup test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s teardown test_rocksdb_options/test.py::test_invalid_options 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_policy 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_options 0.00s setup test_rocksdb_options/test.py::test_valid_column_family_options 0.00s setup test_reloading_storage_configuration/test.py::test_update_disk 0.00s setup test_rocksdb_options/test.py::test_table_valid_options 0.00s setup test_storage_hudi/test.py::test_types 0.00s setup test_storage_hudi/test.py::test_single_hudi_file 0.00s setup test_rocksdb_options/test.py::test_valid_options 0.00s setup test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s setup test_rocksdb_options/test.py::test_table_invalid_options 0.00s teardown test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s setup test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 0.00s setup test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s setup test_rocksdb_options/test.py::test_invalid_options 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s teardown test_rocksdb_options/test.py::test_table_valid_options 0.00s teardown test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s teardown test_rocksdb_options/test.py::test_valid_column_family_options =========================== short test summary info ============================ FAILED test_replication_without_zookeeper/test.py::test_startup_without_zookeeper PASSED test_reloading_storage_configuration/test.py::test_remove_policy PASSED test_reloading_storage_configuration/test.py::test_remove_volume_from_policy PASSED test_reloading_storage_configuration/test.py::test_update_disk PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] PASSED test_rocksdb_options/test.py::test_invalid_column_family_options PASSED test_rocksdb_options/test.py::test_invalid_options PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options PASSED test_rocksdb_options/test.py::test_table_invalid_options PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options PASSED test_rocksdb_options/test.py::test_table_valid_options PASSED test_rocksdb_options/test.py::test_valid_column_family_options PASSED test_rocksdb_options/test.py::test_valid_options PASSED test_storage_hudi/test.py::test_multiple_hudi_files PASSED test_storage_hudi/test.py::test_single_hudi_file PASSED test_storage_hudi/test.py::test_types SKIPPED [1] test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py:29: Disabled for debug and sanitizers. Too slow. ============= 1 failed, 16 passed, 1 skipped in 997.90s (0:16:37) ============== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_laoqnu --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=1e0b53d756cf -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=1 --color=no --durations=0 test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types -vvv" altinityinfra/integration-tests-runner:37a9815fd2fa ' returned non-zero exit status 1.